A general construction for abstract interpretation of higher-order automatic differentiation
نویسندگان
چکیده
We present a novel, general construction to abstractly interpret higher-order automatic differentiation (AD). Our allows one instantiate an abstract interpreter for computing derivatives up chosen order. Furthermore, since our reduces the problem of reasoning about real-valued straight-line programs, it can be instantiated with almost any numerical domain, both relational and non-relational. formally establish soundness this construction. implement technique by instantiating non-relational interval domain zonotope compute first derivatives. In latter case, we are apply abstracting derivatives, hence also interpretation work track correlations across not only different variables, but orders evaluate these instantiations on multiple case studies, namely robustly explaining neural network more precisely network’s Lipschitz constant. For robust interpretation, second computed via AD 4.76× 6.98× precise, respectively, compared AD. certification, obtain bounds that 11,850× precise zonotopes, state-of-the-art interval-based tool.
منابع مشابه
Relational Abstract Interpretation of Higher Order Functional Programs (extended abstract)
Most applications of the abstract interpretation framework[2] have been for analyzing functional programs use functions on abstract values to approximate functions, thus assuming that functions may be called at all arguments. When the abstract domain is finite, this approach can easily be generalized to higher order functional languages as shown for example by [1]. In practice this leads to com...
متن کاملAutomatic Construction of Hoare Proofs from Abstract Interpretation Results
Interpretation Results Sunae Seo, Hongseok Yang, and Kwangkeun Yi 1 Department of Computer Science, Korea Advanced Institute of Science and Technology [email protected] 2 MICROS Research Center, Korea Advanced Institute of Science and Technology [email protected] 3 School of Computer Science and Engineering, Seoul National University [email protected] Abstract. By combining program lo...
متن کاملHigher Order Abstract Interpretation with Flow-Effect Types
This paper describes a novel flow-effect type system that combines concepts of type constraint systems and type effect systems, to achieve a flow-sensitive abstract interpretation of programs with higher-order functions. We prove that a decidable, safe closure algorithm exists. Deriving a decidable type closure algorithm in the presence of higher-order recursive functions is the main technical ...
متن کاملAutomatic Verification by Abstract Interpretation
We discuss the use of abstract interpretation in the context of automatic program veri cation requiring precise abstractions. We compare entirely manual versus user-guided abstractions ranging from program-speci c abstractions including predicate abstraction to the systematic design of abstract domains and iteration strategies. 1 Abstract Interpretation Theory Abstract interpretation theory [1,...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ACM on programming languages
سال: 2022
ISSN: ['2475-1421']
DOI: https://doi.org/10.1145/3563324